TITLE OF THE INVENTION 

PIXEL-DATA SELECTION DEVICE TO PROVIDE MOTION COMPENSATION, AND A 

METHOD THEREOF 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This application claims the benefit of Korean Application No. 2003-38787, filed June 6, 
2003, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein 
by reference. 

BACKGROUND OF THE INVENTION 

1 . Field of the Invention 
[0002] The present invention relates to a pixel-data selection device to provide motion 
compensation, and a method thereof, and more particularly, to a pixel-data selection device to 
provide motion compensation which extracts a plurality of pixel-data by applying a plurality of 
motion trajectories per block during frame rate conversion, and performs motion compensation 
by applying a weight to the extracted pixel-data, and a method thereof. 

2. Description of the Related Art 

[0003] Generally, in a PC or an HDTV, frame rate conversion is performed to exchange 
programs having various broadcasting signal specifications, such as PAL or NTSC. Frame rate 
conversion refers to converting of a number of frames output per minute. Moreover, in the case 
where the frame rate increases, a process of interpolating a new frame is required. 

[0004] Meanwhile, as a broadcasting technology has developed recently, the frame rate 
conversion is performed after compressing an image data by an image data compressing 
method, such as a moving picture experts group (MPEG) and an H.263. Especially, in a field of 
image processing such as the MPEG processing, an image signal usually has redundancy due 
to high autocorrelation. Therefore, by removing the redundancy while compressing the data, 
efficiency of data compression can be improved. Here, for effective compression of a video 
frame which varies according to time, the redundancy in the time-axis direction should be 
removed. 

[0005] The removal of the redundancy in the time-axis direction is based on a concept that 
an amount of data to be transferred is greatly reduced by replacing unchanged portions or 
moved-but-still-similar portions in a current frame with corresponding portions in an immediately 
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preceding frame. 

[0006] To make the replacement, it is necessary to find the most similar block between the 
current frame and a reference frame, which is called "motion estimation." An indication of an 
amount of displacement of the block is called a "motion vector." 

[0007] One of typical methods to estimate motion vectors is a block matching algorithm 
(BMA). The BMA is generally used in consideration of precision, real-time processing ability, 
and hardware implementation and the like. 

[0008] FIG1 is a drawing illustrating a method of estimating motion vectors using a general 
conventional BMA. 

[0009] Referring to FIG.1, F n _i is a previous frame/field, F n is a current frame/field, and Fj is a 
frame to be interpolated using the previous frame/field (F^) and the current frame/field (F n ). 

[0010] The Block Matching Algorithm compares two consecutive images, such as the 
previous frame/field and the current frame/field, by block units, and estimates one motion vector 
per block based on an assumption that the pixels in the compared blocks have translational 
movement. At this time, the motion vector is estimated using a well-known SAD (Sum of 
Absolute Difference) prediction error. When the motion vector is estimated, motion 
compensation is performed with respect to the current block (B), i.e., the block to be interpolated 
using the estimated motion vectors (MV). 

[0011] However, the conventional method of estimating/compensating the motion may have 
an incorrect estimation of respective motion vectors estimated by blocks. If the motion 
compensation is performed with the incorrect motion vectors, block artifacts occur in the 
interpolation frame/field (Fj), as shown in FIG 2. In FIG2, a solid line represents a true motion 
vector, and a dotted line is an estimated motion vector. The block artifacts occur since the 
motion compensation is performed by blocks, and thus the correlation between adjacent blocks 
at the boarder between the blocks is not considered. A conventional frame rate conversion 
(FRC) algorithm may employ a nonlinear filter, such as a median filter, to remove the block 
artifacts. However, the nonlinear filter is not remarkably effective, especially in preventing 
deterioration of image quality. 

SUMMARY OF THE INVENTION 

[0012] Accordingly, it is an aspect of the present invention to provide a pixel-data selection 
device to provide motion compensation, which is capable of preventing or removing block 
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artifacts caused by inaccurately estimated motion vectors, in performing the motion 
compensation by estimating one motion vector per block, and a method thereof. 

[0013] Additional aspects and advantages of the invention will be set forth in part in the 
description which follows and, in part, will be obvious from the description, or may be learned by 
practice of the invention. 

[0014] The foregoing and/or other aspects of the present invention are achieved by providing 
a pixel-data selection device to provide motion compensation, the device including a first 
storage part, a second storage part, first and a second pixel-data extraction parts, and first and 
a second compensation pixel calculation parts. 

[0015] The first storage part can store a current frame/field which includes a first pixel-data 
corresponding to at least one of candidate motion vectors as inputted. The second storage part 
can store a previous frame/field which includes a second pixel-data corresponding to the at 
least one of the candidate motion vectors. The first and the second pixel-data extraction parts 
extract the first and the second pixel-data, which correspond to the at least one candidate 
motion vector, respectively, from the first and the second storage parts, respectively. Further, 
the first and the second compensation pixel calculation parts calculate, respectively, a first and 
a second compensation pixel-data for motion compensation, by adaptively applying at least one 
predetermined first weight according to the first and the second pixel-data. The calculated first 
and second compensation pixel-data are used for the motion compensation of a current block to 
be interpolated. 

[0016] In particular, the first and the second pixel-data extraction parts can extract the first 
and the second zero pixel-data corresponding to a block having the candidate motion vector of 
zero, respectively from the first and the second storage parts, and the abstracted first and 
second zero pixel-data can be used for the motion compensation of the current block. 

[0017] In addition, the first and the second compensation pixel calculation parts respectively 
multiply the first and the second pixel-data by the first weights, which is adaptively applied 
according to the first and the second pixel-data, and add the results of the multiplication to 
obtain the first and the second compensation pixel-data, respectively. 

[0018] The sum total of the first weights applied by the first and the second pixel-data is 1 . 

[0019] Further, the candidate motion vector may include the motion vector of the current 
block in the current frame/field and a motion vector of at least one peripheral block adjacent to 
the current block. 



3 



[0020] At least one of the candidate motion vectors is a vector estimated from a position 
corresponding to the minimum value, among a plurality of motion prediction errors calculated by 
applying a block matching algorithm with respect to the current block and the respective 
peripheral blocks. 

[0021] In an aspect of the invention, the first weight, which is applied according to at least 
one of the first and the second pixel-data, is inversely proportional to the motion prediction error 
calculated by the current block and the peripheral blocks. 

[0022] The motion prediction error may be calculated by a sum of absolute difference (SAD) 
or a mean absolute difference (MAD). 

[0023] In addition, the pixel-data selection device may further include a first delay device to 
delay an inputted frame/field for a predetermined time period, and to supply the delayed current 
frame/field to the first storage part, and a second delay device to delay the current frame/field 
inputted from the first delay device, for a predetermined time period, and to supply the delayed 
previous frame/field to the second storage part. 

[0024] The first and the second pixel-data extraction parts extract at least one of the first and 
the second pixel-data by estimating motion trajectories by at least one of the candidate motion 
vectors. 

[0025] The first and the second storage parts store adjacent fields of the same property, and 
the fields of the same property are one of an odd field and an even field. 

[0026] In addition, the device may further include, with the frame/field being inputted by a 
field unit, a first delay device to delay an inputted field for a predetermined time period, and to 
supply the delayed first field to the first storage part, a second delay device to delay the first field 
inputted from the first delay device, for a predetermined time period, and to output the delayed 
second field, and a third delay device to delay the second field inputted from the second delay 
device, for a predetermined time period, and to supply the delayed third field to the second 
storage part, wherein the first and the third fields are of the same property. 

[0027] The foregoing and/or other aspects of the present invention are also achieved by 
providing a method of pixel-data selection for motion compensation, of the method comprising: 
storing a current frame/field including at least one of a first pixel-data corresponding to at least 
one of candidate motion vectors as inputted, storing a previous frame/field including at least one 
of a second pixel-data corresponding to the at least one of the candidate motion vectors, 
extracting the first and the second pixel-data, which respectively correspond to the at least one 
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candidate motion vector, respectively, from the first and the second storage parts; and 
calculating respectively the first and the second compensation pixel-data for motion 
compensation, by adaptively applying at least one predetermined first weight according to the 
first and the second pixel-data. The calculated first and second compensation pixel-data are 
used for the motion compensation of a current block to be interpolated. 

[0028] More particularly, the first and the second pixel-data extracting operations extract the 
first and the second zero pixel-data corresponding to a block having the candidate motion vector 
of zero, respectively from the first and the second storage parts, and the extracted first and 
second zero pixel-data are used for the motion compensation of the current block. 

[0029] The first and the second compensation pixel calculating operations multiply the first 
and the second pixel-data by the first weights, respectively, which are adaptively applied 
according to the first and the second pixel-data, and add the results of the multiplication to 
obtain the first and the second compensation pixel-data, respectively. 

[0030] In an aspect of this invention, the pixel-data selection method further includes the 
operations of, prior to the current frame/field storing operation, delaying an inputted frame/field 
for a predetermined time, and outputting the delayed current frame/field, and prior to the 
previous frame/field storing operation, delaying the current frame/field inputted from the first 
delay device, for a predetermined time, and supplying the delayed previous frame/field to the 
second storage part. 

[0031] The first and the second pixel-data extracting operations extract at least one of the 
first and the second pixel-data by estimating motion trajectories by at least one of the candidate 
motion vectors. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0032] These and other objects and advantages of the present invention will become 
apparent and more readily appreciated from the following description of the embodiments, taken 
in conjunction with the accompanying drawings of which: These and other features, aspects, 
and advantages of the present invention will become better understood with regard to the 
following description, appended claims, and accompanying drawings where: 

[0033] FIG 1 is a drawing illustrating a method for estimating motion vectors using a general 
conventional block matching algorithm; 

[0034] FIG 2 is an example simulation of an image where block artifacts occur by a general 
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conventional method of motion compensation; 

[0035] FIG 3 is a block diagram schematically illustrating a motion estimation/compensation 
device where a pixel-data selection device is installed according to an embodiment of the 
present invention; 

[0036] FIG. 4A illustrates a current block and peripheral blocks set for the motion estimation 
in a motion estimation part of FIG 3; 

[0037] FIG 4B illustrates a final motion vector with respect to the current and the peripheral 
blocks of FIG 4A, respectively; 

[0038] FIG 5 schematically illustrates motion trajectories with respect to a certain position of 
a frame/field which is to be interpolated, using the final motion vector of the current and the 
peripheral blocks of FIG 4B; 

[0039] FIG 6 is an example simulation of an image where the block artifacts are removed by 
the motion estimation/compensation device of FIG 3; 

[0040] FIG 7 is a block diagram schematically illustrating a motion estimation/compensation 
device where the pixel-data selection device is installed according to another embodiment of the 
present invention; and 

[0041] FIG 8 is a flowchart schematically illustrating the motion estimation/compensation 
method of estimating motion vectors by selecting pixel-data as shown in FIG 3. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0042] Reference will now be made in detail to the embodiments of the present invention, 
examples of which are illustrated in the accompanying drawings, wherein like reference 
numerals refer to the like elements throughout. The embodiments are described below in order 
to explain the present invention by referring to the figures. 

[0043] FIG 3 is a block diagram schematically illustrating a motion estimation/compensation 
device where a pixel-data selection device is installed according to an embodiment of the 
present invention. 

[0044] Referring to FIG 3, a motion estimation/compensation device 300 installed with a 
pixel-data selection device according to this embodiment of the present invention may include a 
first delay device 310, a second delay device 320, a motion estimation part 330, a pixel-data 
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selection part 340 and a motion compensation interpolation part 370. The present invention 
relates to a frame rate conversion or an MPEG technique to estimate a plurality of motion 
vectors and to compensate the motion vectors, and will be described only with reference to 
blocks that are related to the motion estimation/compensation. 

[0045] The first delay device 31 0 delays an inputted frame/field for a predetermined time 
period, and provides the first delay frame/field to the second delay device 320 and a first 
storage part 341 . The second delay device 320 delays the first delay frame/field inputted from 
the first delay device 310, and provides the second delay frame/field to the second storage part 
361 . Hereinafter, the first delay frame/field is referred to as the current frame/field (F n ), and the 
second delay frame/field is refered to as the previous frame/field (Fn.0. 

[0046] Meanwhile, in a case where the motion estimation/compensation device 300, installed 
with the pixel-data selection device according to FIG 3, converts a frame rate of an image which 
is inputted by interlacing, the first delay frame/field is the current frame/field (F„), and the second 
delay frame/field is the previous frame/field (F M ). Therefore, when the previous field is an odd 
or an even numbered field, the current field becomes an even or an odd numbered field, 
respectively, corresponding to the previous field. 

[0047] The motion estimation part 330 estimates the motion vectors between the previous 
frame/field (F^) and the current frame/field (F n ) through BMA. To estimate the motion vectors, 
the motion estimation part 330 has a motion vector estimation part 332 and a motion prediction 
error calculation part 334. 

[0048] The motion vector estimation part 332 divides the current frame/field (F„) into blocks 
of a predetermined size to be interpolated, and calculates a plurality of motion prediction errors 
with respect to the respective blocks to be interpolated by matching the divided blocks with a 
plurality of blocks constituting the previous frame/field (F n .,) respectively, in a single direction. 

[0049] More specifically, the motion vector estimation part 332 sets up a predetermined 
searching range S, as shown in FIG. 4A, in the current frame/field (F n ) which is divided into the 
blocks of predetermined sizes. The motion vector estimation part 332 also calculates a plurality 
of motion prediction errors with respect to the respective blocks to be interpolated by matching 
the blocks to be interpolated in the searching range with a plurality of blocks constituting the 
previous frame/field (F^) respectively, in a single direction, or in two directions. 

[0050] The motion prediction error can be calculated by a variety of methods such as by a 
Sum of Absolute Difference (SAD) method, a Mean Absolute Difference (MAD) method and the 
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like. The SAD is employed in this embodiment of the present invention. 

[0051] When a plurality of SADs are calculated with respect to the respective blocks to be 
interpolated, the motion vector estimation part 332 estimates the motion vectors of the 
respective blocks using an Equation 1 below. 

[0052] [Equation 1] 

v = arg min vG5 {0(v)} 

[0053] Referring to [Equation 1], 4>(v) is an SAD, v is a motion vector of a block having a 
minimum SAD (from now on, V represents a vector), and S is the searching range. The motion 
vector estimation part 332 estimates the motion vectors of the respective blocks to be 
interpolated starting from a position which includes the minimum SAD among a plurality of 
SADs calculated by the respective blocks to be interpolated. 

[0054] When the final motion vector of the current block B 0 to be interpolated is v 0 in FIG. 4B, 
the final vectors of the peripheral blocks B^ to B 8 are Vi to v 8i respectively. 

[0055] Meanwhile, the searching range S, set up in the current frame/field F n , refers to an 
area to be interpolated in interpolation frame/field Fj. The number of blocks existing in the 
searching range S can be set up variously according to the size of the blocks and/or the 
searching range S. 

[0056] Further, the motion vector estimation part 332 provides the motion prediction error 
calculation part 334 with a zero motion vector v z , of which the motion vector of the current block 
B 0 to be interpolated, as well as the motion vectors v 0 to v 8 of the respective blocks B 0 to B 8 
existing in the searching range S, is zero. This is because compensating regardless of the 
motions is more correct than estimating the motion vectors by BMA in a case where the motions 
are complicated and not in a translation movement, in a process of the motion compensation. 
The motion compensation process will be described below. 

[0057] The motion prediction error calculating part 334 extracts the SAD corresponding to the 
motion vectors v z and v 0 to v 8 supplied from the motion vector estimation part 332, using an 
[Equation 2] below. 

[0058] [Equation 2] 

®M = I,\f(x + v i9 n-iyf(x,n)\J = 0X2^M 
xeB 
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[0059] Here, <D(v,) represents the SAD corresponding to the respective motion vectors v 0 to 
v 8 , x represents a vector as a coordinate data of a predetermined pixel located in a 
predetermined block which is one of B 0 to B 8| v s represents motion vectors v 0 to v 8 of the 
respective blocks B 0 to B 8 , n represents time intervals between the previous frame/field (F n _-,) 
and the current frame/field (F n ), and M represents the number of the respective blocks B 0 to B 8 
existing in the searching range S. The motion prediction error calculation part 334 also extracts 
the SAD with respect to the zero motion vector v 2 of the current block B 0 to be interpolated, 
using the [Equation 2]. 

[0060] Referring to [Equation 2], the motion prediction error calculation part 334 extracts the 
SAD corresponding to the motion vectors to v 8 of the respective peripheral blocks B, to B 8 and 
the zero motion vector v Zl among all the SADs calculated with respect to the current block B 0 . 
That is, the motion vectors v 2 and v 0 to v 8 , which are provided by the motion vector estimation 
part 332, are applied as candidate motion vectors of the current block B 0 to be interpolated. 

[0061] This is performed in order to do motion compensation more accurately when the 
motion vector v 0 of the current block B 0 is inaccurately estimated, by replacing motion vectors of 
better-estimated blocks among the peripheral blocks B^ to B 8 , i.e., a block having the minimum 
SAD, with the final motion vector of the current block B 0 , or performing the motion compensation 
more correctly by applying a weight to pixels corresponding to the better-estimated peripheral 
blocks Bi to B 8 . 

[0062] That is, the motion compensation, according to this embodiment of the present 
invention, is performed considering the motion trajectories of the peripheral blocks B^ to B 8 as 
well as the current block B 0 , assuming that motions between the blocks B 0 to B 8 are smooth. 
This is to prevent the occurrence of block artifacts caused when the motion vector v 0 of the 
current block B 0 is inaccurately estimated, as illustrated, for example, in FIG. 2. 

[0063] Meanwhile, when the SADs corresponding to the respective candidate motion vectors 
v ZJ v 0 to v 8 are extracted out, the motion prediction error calculation part 334 supplies the 
respective SADs to first and the second compensation pixel calculation parts 353and 363. 

[0064] Further, first and second pixel-data extraction parts 352and 362, respectively, are 
provided with the motion trajectories considered by the motion vectors of the respective blocks 
B 0 to B 8 estimated from the motion vector estimation part 332, or provided with the motion 
vectors (not shown) which are estimated with respect to all the divided blocks (not shown). 

[0065] FIG. 5 schematically illustrates motion trajectories with respect to a predetermined 
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position of a frame/field to be interpolated, using the final motion vector of the current and the 
peripheral blocks. 

[0066] Referring to FIG 5, is a previous frame/field, F n is a current frame/field, and F ( is a 
frame/field to be interpolated. The previous frame/field (F^) and the current frame/field (F„) are 
inputted consecutively. A temporary compensation pixel-data with respect to the certain position 
of the interpolation frame/field (F f ) is calculated by using an [Equation 3] below. 

[0067] [Equation 3] 

f lix , n -V2) = M x+v >< 2 '"- l l + M x - v ' /2 >"\ ; = 0,1,2,..., Af 

[0068] Here, (n-1/2) represents a temporal position of the frame/field (Fi) to be interpolated, f, 
(x, n-1/2) represents a temporary compensation pixel-data of the interpolation frame/field (F|) at 
the x position, and Vi represents the final motion vector v 0 of the current block B 0 , and the final 
motion vectors v, to v 8 of the peripheral blocks B, to B 8 . 

[0069] Referring to the [Equation 3] above, M represents the number of the considered 
motion trajectories. The temporary compensation pixel-data f, (x, n-1/2) at the x position, which 
is obtained by a plurality of motion trajectories, is calculated while considering the plurality of 
final motion vectors v 0 to v 8 which are calculated from the [Equation 2]. In this manner, the block 
artifacts, which are usually caused due to inaccurately estimated final motion vector v 0 of the 
current block B 0) can be prevented. 

[0070] Meanwhile, for the candidate motion vectors v 0 to v 8 of the current block B 0 to be 
interpolated as described, not only the final motion vectors v 0 to v 8 with respect to the peripheral 
blocks Bt to B 8 , but also global motion vectors detected through a motion analysis process and 
motion vectors detected in the previous frame/field of the same position, can be re-used. 
Further, the transformed motion vectors, which are obtained by a median filter of the candidate 
motion vectors or an average filter, can be used for the candidate motion vectors of the current 
block B 0 . 

[0071] Referring to FIG. 3, the pixel-data selection part 340 selects at least one 
compensation pixel using pixel-data of pixels constituting a frame/field inputted therein, a 
plurality of SADs provided by the motion estimation part 330, and the candidate motion vectors. 
To select at least one compensation pixel, the pixel-data selection part 340 according to this 
embodiment comprises a first storage part 351, the first pixel-data extraction part 352, the first 
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compensation pixel calculation part 353, a second storage part 361, the second pixel-data 
extraction part 362, and the second compensation pixel calculation part 363. 

[0072] In the first storage part 351 , pixel-data of the pixels constituting the current frame/field 
(F n ) inputted from the first delay device 310 are temporarily stored. 

[0073] The first pixel-data extraction part 352 extracts the first pixel-data l 0 to l 8 corresponding 
to the respective final motion vectors v 0 to v 8 inputted from the motion vector estimation part 
332, starting from the pixel-data of the current frame/field (F n ) stored in the first storage part 
351. The first pixel-data l 0 to l 8 is expressed by an [Equation 4] below. 

[0074] [Equation 4] 

l i =f i (x-v i /2,n),i = 0X...,M 

[0075] Referring to [Equation 4], the pixel-data extracted by the first pixel-data extraction part 
352 have the first pixel-data l 0 to l 8 , and the number of the first pixel-data corresponds to the 
number of the candidate motion vectors which are estimated at the motion estimation part 330. 

[0076] In addition, the first pixel-data extraction part 352 extracts from the first storage part 
351 the first pixel-data l z corresponding to the zero motion vector v 2 inputted from the motion 
vector estimation part 332, and supplies the first pixel-data to the motion compensation 
interpolation part 370. Here, the first pixel-data extraction part 352 may recognize the candidate 
motion vector having zero value as the zero motion vector v 2 , and extracts a compensating 
pixel-data l 2 for a block having a candidate motion vector which is zero. 

[0077] The first compensation pixel calculation part 353 considers accuracy at the respective 
motion trajectories using the SAD corresponding to the respective blocks B 0 to B 8 inputted from 
the motion estimation error calculation part 332, and applies a predetermined weight to the 
respective temporary compensation pixel-data calculated by the [Equation 3]. That is, the first 
compensation pixel calculation part 353 calculates the first compensation pixel-data I' which is 
applied with the weight, using [Equation 4] to [Equation 7]. 

[0078] [Equation 5] 

M MM 
f w (x,n-\/2)= £ w )f.(x,n-\/2)=Z w.l.+ £ w.r.=/'+r* 
i=0 1 1 i=0 1 1 i=0 1 1 

[0079] Here, the weight Wj needs to satisfy [Equation 6], and the weights with respect to the 
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respective motion trajectories are calculated by [Equation 7]. 

[0080] [Equation 6] 

M 

2>,=1 
/=0 



[0081] [Equation 7] 

Wi= > i = 0 > l >~> M 

Zl/0>(v) 
/=0 

[0082] Referring to [Equation 5] through [Equation 7], the first compensation pixel-data I' 
calculated from the first compensation pixel calculation part 353, are as follows. This is because 
r, is zero since only pixel-data with respect to the current frame/field (F n ) are stored in the first 
storage part 351. 

M 

[0083] V=Yw.l. 

[0084] In addition, the weight Wi with respect to the respective motion trajectories is inversely 
proportional to the minimum SADs of the respective blocks B 0 to B 8 . That is, the first 
compensation pixel calculation part 353 recognizes that the smaller the minimum SAD is, in 
comparing the minimum SADs of the respective blocks B 0 to B 8 , the more accurate motion 
estimation has been performed, and therefore applies the weight Wj which is inversely 
proportional to the minimum SADs. That is, the accuracy in the respective motion trajectories is 
determined depending on the SADs. 

[0085] On the other hand, in the second storage part 361 , pixel-data of the previous 
frame/field (F^) inputted from the first delay device 310 is temporarily stored. 

[0086] The second pixel-data extraction part 362 extracts the second pixel-data r 0 to r 8 , 
respectively, corresponding to the final motion vectors to v 8 inputted from the motion vector 
estimation part 332, from the pixel-data of the previous frame/field (Fm) stored in the second 
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storage part 361. The second pixel-data r 0 to r 8 are calculated by an [Equation 8] below. 
[0087] [Equation 8] 

r i =f i (x-v i /2,n),i = 0,l,...,M 

[0088] Referring to the [Equation 8], the pixel-data extracted out from the second pixel-data 
extraction part 362 have the second pixel-data r 0 to r 8 , respectively. Further, the second pixel- 
data extraction part 362 extracts the second pixel-data r 2 corresponding to the zero motion 
vector v z inputted from the motion vector estimation part 332, from the second storage part 361 . 
The second pixel-data extraction part 362 may recognize the candidate motion vector having 
zero value as the zero motion vector, and extracts the compensating pixel-data r 2 corresponding 
to a block having the candidate motion vector which is zero. 

[0089] The second compensation pixel calculation part 363 considers accuracy at the 
respective motion trajectories using the minimum SADs of the respective blocks B 0 to B 8 
inputted from the motion estimation error calculation part 332, and applies a predetermined 
weight to the respective temporary compensation pixel-data calculated by the [Equation 3]. 
That is, the second compensation pixel calculation part 363 calculates the second 
compensation pixel-data r' which is applied with the weight, using the [Equation 5] to [Equation 
8]. 

[0090] Referring to [Equation 5] to [Equation 8], the second compensation pixel-data r' 
calculated at the second compensation pixel-data calculation part 363 is as follows. This is 
because \, is zero since only pixel-data with respect to the previous frame/field (F^) are stored 
in the second storage part 361. 

[0091] r'=Vw.r. 

[0092] As described above, the pixel-data selection part 340 calculates or extracts the first 
and the second compensation pixel-data I'and r', respectively, and the first and the second pixel- 
data l z and r z , respectively, for temporal averaging, and supplies the data to the motion 
compensation interpolation part 370. 

[0093] The motion compensation interpolation part 370 calculates the final interpolation pixel- 
data f using a soft switching value k inputted from a reliability calculation part (not shown). The 
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final interpolation pixel-data f is calculated by the following [Equation 9]. 
[0094] [Equation 9] 



/(x,/i-l/2) = ^g Wf /Xx > ii-l/2)) + a-ib)( /(x>w "^ +/( ^ w) ) 

[0095] In the [Equation 9], k is the soft switching value to adaptively apply the first and the 
second compensation pixel-data I' and r', respectively, for the motion compensation, and also 
the first and the second pixel-data l z and r z , respectively, which are irrespective of the motion. 
The value k is determined according to the reliability of the first and the second compensation 
pixel-data I' and r', respectively. That is, when the reliability of the first and the second 
compensation pixel-data I' and r\ respectively, are higher than that of the first and the second 
pixel-data l z and r Zl respectively, k increases to calculate the final interpolation pixel-data f to 
which more of the first and the second compensation pixel-data I' and r'.respectively, are 
applied. On the other hand, when the reliability of the first and the second compensation pixel- 
data I' and r\ respectively, are lower than that of the first and second pixel-data l z and r z , 
respectively, k decreases to calculate the final interpolation pixel-data f to which more of the first 
and the second pixel-data l z and r z , respectively, are applied. 

[0096] Accordingly, there can be provided an image with less block artifacts phenomenon, as 
illustrated in FIG. 6, by employing the final interpolation pixel-data f considering a plurality of the 
motion trajectories, based on an assumption that motions between the blocks are smooth. In 
FIG. 6, the solid line refers to the estimated motion vector. 

[0097] Meanwhile, FIG 7 is a block diagram schematically showing the motion 
estimation/compensation device according to another embodiment of the present invention. 

[0098] Referring to FIG 7, the motion estimation/compensation device 700 includes a first 
delay device 710, a second delay device 715, a third delay device 720, a motion estimation part 
730, a pixel selection part 740 and a motion compensation interpolation part 770. Since the 
present invention relates to the frame interpolation which compensates the motion by estimating 
a motion, the frame rate conversion device (not shown) will be described by illustrating the block 
related to the motion estimation/compensation only. 

[0099] The motion estimation/compensation device 700 performs motion compensation using 
adjacent fields of the same property, and includes the motion estimation part 730, the pixel 
selection part 740 and the motion compensation interpolation part 770 of FIG. 7, of which a 
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detailed description will be omitted since they are identical or similar in functions with the motion 
estimation part 330, the pixel-data selection part 340 and the motion compensation interpolation 
part 370 of FIG. 3. 

[00100] Yet, while the motion estimation/compensation device 300 of FIG. 3 provides frame 
rate conversion of an image signal inputted by a frame unit or a field unit, the motion 
estimation/compensation device 700 of FIG. 7 is directed to providing frame rate conversion of 
an image signal which is inputted by a field unit. That is, while the motion 
estimation/compensation device 300 calculates the final interpolation pixel-data f for motion 
compensation between frames or between an odd field and an even field, the motion 
estimation/compensation device 700 of this embodiment calculates the final interpolation pixel- 
data f between odd fields or between even fields. 

[00101] To be more specific, when a field outputted from the first delay device 71 0 is a first 
odd field, a field outputted from the second delay device 715 is a first even field, and a field 
outputted from the third delay device 720 is a second odd field. That is, the first odd field is the 
current field, and the second field is the previous field. 

[00102] Also, the motion vector estimation part 732 estimates a plurality of motion vectors for 
the motion compensation between the first and the second odd fields having the same property. 
The motion vector can be estimated by calculating the motion prediction error. The motion 
prediction error calculation part 734 extracts the motion prediction error corresponding to the 
estimated motion vector, among the calculated motion prediction errors. According to the 
embodiments of present invention, the SAD is used for the motion prediction error. 

[00103] The pixel selection part 740 calculates at least one compensation pixel l 2 , r z , l\ r', 
using the pixel-data of the first and the second field inputted from an outside source, a plurality 
of the final motion vector and a plurality of SADs. For this, the pixel selection part 740 
according to this embodiment includes a first storage unit 751 , a first pixel-data extraction part 
752, a first compensation pixel abstraction part 753, a second storage unit 761, a second pixel- 
data extraction part 762, and a second compensation pixel abstraction part 763, similar to the 
embodiment of FIG 3. 

[00104] The motion compensation interpolation part 770 calculates the final interpolation pixel- 
data f according to the soft switching value k, using the first and the second compensation pixel- 
data r and r\ respectively, supplied from the pixel selection part 730, and the first and the 
second pixel-data l 2 and r z , respectively. 
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[00105] The motion compensation interpolation part 770 calculates the final interpolation pixel- 
data f using the soft switching value k inputted from the reliability calculation part (not shown). 
The final interpolation pixel-data f is calculated by the [Equation 9]. 

[00106] FIG. 8 is a flowchart schematically illustrating the motion estimation/compensation 
method of estimating motion vectors by selecting pixel-data according to FIG. 3. 

[001 07] Regarding FIG. 8, first the first delay device 310 delays the inputted frame/field for a 
predetermined time period and outputs the current frame/field. The second delay device 320 
delays the current frame/field (F„) for a predetermined time period and outputs the previous 
frame/field (F n .i). The outputted current frame/field (F n ) and the previous frame/field (F^) are 
stored in the first and the second storage parts 351 and 361, respectively, in operation S810. 

[00108] When the frame/field is inputted by interlacing, the current frame/field (F n ) is an odd or 
an even field, and the previous frame/field (F n .,) is an even or an odd field. 

[00109] In addition, the motion estimation part 330 calculates the minimum SADs with respect 
to the current block B 0 to be interpolated and the peripheral blocks to B„, respectively, using 
the BMA. Further, the motion estimation part 330 estimates the respective final motion vectors 
v 0 to v 8 from the respective positions having the minimum SADs, and extracts the SADs 
corresponding to the current block B 0 to be interpolated and the peripheral blocks B^ to B 8 , 
respectively, in operation S820. Here, the final motion vectors v 0 to v 8 with respect to the current 
block B 0 to be interpolated and the peripheral blocks B, to B 8 are designated as the candidate 
motion vector of the current block B 0 . 

[001 10] When there is a zero motion vector v z having zero value among the final motion 
vectors v 0 to v 8 which are estimated in operation S820, the pixel-data selection part 340 extracts 

the first and the second pixel-data l z , lj, r 2 , r, (here, i=0, 1 M) corresponding to the plurality of 

candidate motion vectors including the zero motion vector v z in operation S830. 

[001 1 1] When operation S830 is completed, the pixel-data selection part 340 calculates a 
predetermined weight to apply to the extracted first and second pixel-data l 2 , \„ r z , r ( (here, i=0, 

1 M), using [Equation 7] in operation (S840). Then, the pixel-data selection part 340 

calculates the first and the second compensation pixel-data I' and r', respectively, which are 
applied with the weight, using [Equation 5] in operation S850. 

[001 12] When operation S850 is completed, the motion compensation interpolation part 370 
calculates the final compensation pixel-data f by adaptively applying the soft switching value k to 
the calculated first and second compensation pixel-data I' and r', respectively, in operation 



16 



S860. 

[001 13] According to the motion estimation/compensation devices 300 and 700 and the 
method of the same as described above, in performing the motion compensation of the blocks 
to be interpolated, the final motion vectors Vi to v 8 of the peripheral blocks B! to B 8 as well as the 
final motion vector v 0 of the current block B 0 , are used. That is, after SADs are calculated in the 
respective motion trajectories using the final motion vectors v 0 to v 8 of the current block B 0 and 
the peripheral blocks Bi to B 8| the weight is calculated using the SADs. Further, the block 
artifacts occurring when the final motion vector v 0 of the current block B 0 is inaccurate, as shown 
in FIG. 2, can be prevented by applying the weight inversely proportional to the calculated 
SADs. That is, in the image outputted from the motion estimation/compensation device 300 
according to FIG 3, the block artifacts phenomenon is removed, as illustrated in FIG. 6. 

[00114] As described above, the motion estimation/compensation device 300, capable of 
selecting the compensating pixel-data according to the embodiment of FIG 3, extracts a 
plurality of compensating pixel-data to interpolate the current block B 0 by estimating not only the 
motion vector of the current block B 0l but also the motion vector of the peripheral blocks B, to B 8 
adjacent to the current block. Accordingly, by considering the plurality of motion trajectories by 
the plurality of extracted compensating pixel-data, the block artifacts can be prevented or 
reduced, which is caused by an inaccurate estimation of the motion vector of the current block 
B 0 . In addition, hardware can be more simply structured since all the motion trajectories which 
can be considered for a plurality of motion vectors are applied without additional processes. 

[00115] While the invention has been shown and described with reference to certain preferred 
embodiments thereof, it will be understood by those skilled in the art that various changes in 
form and details may be made therein without departing from the spirit and scope of the 
invention as defined by the appended claims and equivalents thereof. 
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